© B * H » » /f (J P) © # » tB B 4^ BB 

• ^HSEpiff^* (A) 0^64-88875 

©Int.Cl.* gaSUIB^ jr«ffl#* O^M SS?P64^(1989)4^3B 

G 06 F 15/38 V-7313-5B 

3/16 3 40 Q-7341-5B g ^ ^ t 

P 0862- 246149 
@m PS62(1987)9fl30a 

©n n * a n * ^iiwi»**Km70WBs ***6a3K2Wflri*rt 
©aiPA t* 5£ £ ft nc 2 »«Jii»;i»?B*EitJiW72»i6 



Dfl «B W 

1 . ft « <0 € ft 

* * a SR 55 s 

2 . ft ft 2* * <D *5 BB 

(2) to^J^ t 1 ^ r»gti^ jatHSSS t^^SK 

* * * « * urtn^nwifr-citizi 

* « w a » « * s » « ^ ra-c © « as * * * * 



( ft * © t* « > 
t|l|jR»JEd««iL6At^4, C tf) « f3 & SR £ 

a I* * ffl ft *< as * &nTi****ffla«s*«« 
bp $ . «^AA*nfcB*ffi*a*»*i»ffia 

a 8 is -c a a l * :oa»*ftfc*fiSfiffl*n* 

tc tft ftSt * *i s o 



-519- 



1*tS)B3U4- 88875 (2) 



C O J; -5 f |5 ffl 


5? £5 ec 






w 




^< 










i 9 






*> 


it 


l: 


ft fl 












-#co#iffl#wa* 


35 * * 




ffl * (W 






( 


% 




^ w 




L <t 




£ 


r 








) 










* $> o a sns ft * b 


* ffi © 


)9t L *C Bfl & s 


* ft fib 








<0 






ft 


^ <c 






T 














St 




P A 


L ti i>< to ft ^ 


M ^ to 


L 


T 




» 


ca 


S t 




iz X 


0 


w 










t * 








c0iB3Stf}ft££2S^ 


pa 


x Bfl < :iJj<^l 


ffi £ li- 


5S 




HI 




ft 


ft * 


-a* 






^< 




« 




CO S 


3S * 






w 


c c * <o » jk 


3 IS ( 


*i 3S ) £ a * 


ft 4 o 








W 


— 




> 






tT 


L 




IE 


or ic 






L 


T 




i ; 6 ji< : © <t ? 


if * 


« ft S EE * % RE 


\z % m 


ti 




t 










* 0 






ffl 
























i: 


ft 








ft 




r> ft 


a 






















-5o f « t> >C MX 


2* 3 <i 


A -h 1= *J + 






* 


9k 






C «0 


J; 






« 








L T 




ft 


ft 


ft 




4*cOffiJK&J3£T* 


0 s tit 


K o IS^ ( ffi ft 


) ^ffi 


<o 










s w 


4 












s 


rt ^ 












<P & IS $ < » ft ) 


£ U * 


C 4 # * * -5 


• c <0 






ft 








U 


< s 




ft 








CO w 


35 




SI 


* 


+ 


IS /ft, «8 2R$nTS 


js aj a 


3 n * t & tt ft 


© 2S 




\z 




ts 


L 




to 














r co 








ft 




ft ^ a T > 71 ffi K 




& flP # J&< ft O - 


a r V 




iz 






$ 






«i re 




+ 












ffi 


* 




(ft 




# n t< 


& 'A iz *> o ft o 






•& 




































Zcoj:ott#&- 


a. r > 


X 0 & ti 5 ffi ft 


S ^ ^< 




C 






o 


+« file 


3 


























& # ft ft * £ * * <0 


At S l= 


l> T 8 JW £ 


U ft *? , 






( 






£ * 




ik T 




ft 


16 


(0 


















Jt>< A 0 


„ ifr w % p m 


SR K £ 






* 


5ft 




fi A 






















5U 


£ 




5 >j ^ 3i ffl *> 


n * 4 


5 -3 * A £ * 


e ^ G 




CO 






IS 


IS ft 


ft 


ft tt 




ti! 


ft 








co 


a 


ft 




ft 




co a 


^ to , fifl tt Hi 


* * ft 






ft 










i * 




ti? 


t 


ft 






» 










& ifo m P ft \1 (i 


* co *t 


» g a * + ^ i 




l» 


r 




































ffiSKjrccomsHBft 


t a w 


* o * a t» « & 


* * CD 






1 










2 SI 


fi 


* 


ft 




CD 












ay. 
a 




& -tf r 


. w x. «r # * hi 






« 






iff 


CO 




to U 


m 




m 






+ EQ 


T 




0 




ft) 


i. » & ffi i * ffl l> 


r ± se 


n » us % « a as 


t3 ft * 






tg 




* 151 


T 


to # 




ffi 










ft 


ft 






s 


g ^ $ ct £ >T> * ^ 


^Ji l 


T ^ ft ? +1 * 


t a * 


«b 


t 


r 




m 


ft ft 




o w 








2J 




* 1 


CO 


W 


ffl 


* 


<0 




5 V> T 








m 




S5 




n * 




T * 


t> 








* 2 




f»J 






<0 


( ft m ) 








ffi 


m 








it «k 

7C RU 




* -5 










Jfi 






(i 


a 


* 


35 


* * W C J: *i If 


. ffiSR 


in ^ (o § 25 +^ ft 




- 


£ 








<o « 




IS ft 


* 


rr 






t 


CO £ 


* 




4 






* tf * 3= 3»J J: tf W 


9 4 




4 T (= 










S 






<£ ^ 








ft 


ft 


* o 














SOT 


, W X- tf # i« tt 


-ft ft ft 










it 


r* ul 






ti 






& 




1 


to 




i« 


A 




ft a« to ft * Dfl & 


a< to x 




ta ft 


ft 


ft 




a 








* # 


P> 






r 




h £0 


T 




B 




3« 


n' ft » ss w » * « & 


tK 


i jJ< T M g o 


£U 


SK 


iff 


4 


(i 




CO 12 




ft ft 


ft 


B 


* 


:s 






ft 




3& 








T 88 IR 


n? to f tfi m'« i 


Sfi SR % 




ts 


ft 






« 


* 


. t 


ft* 


3£ 


■a 








t$ 


5 


(i 


IS 






**■ 5 C 


i A< nf ffi i fi 


• - <o 




* 


2 




to 


!■ 


A 


i) ft 


ft 




3£ 






^ ^ 


A 
P 




IS 






iU * W ffi * ( ft IS 


* ) tt 


« m a & k w 








CO 






^ a 


$1 


ft U 


6 


(i 


w 


CO 




^ ft 


ft 


ft 




& 






ft* *c 


> ft ^ W o £ j* 


W - ^ 






ft 




B 




If 


& ft 


ft 


iz 




a 




* » 














4 d< "0 


ffi i s ffl /i 


w * * 






1 




iZ 






^ ffi 


W 




ffi 




u 




& 


U 


ft 


to 


< 




\Z 8/j <' 


c £ A* 5J fig i t£ 








ft 


ft 


ft 




« 


ft * 


iS 


*5 


Yr. 
PI 




& 




7 


iz 


r 






( 3? Sfc fifq > 








s- 


-a 






ok 






T «S 


ss 






2 






tfi 


-ft 


L 






KIT, Bl i& * 0 


M L T 




W K ^> 


ft 


3 




& 








m 8 




T 


a 








(C 


& 








$ $ V\ * S • 








L 


T 




35 




* J 




* * 


fcH 




r 


4 




CO £ 






r 







-520- 



c ft tz in a. x *e ss m * i at -c « s n u a * i k fiy 
r * *> * ft * H*a«wro«irw««T*a3tss 

X * * Ifi & L /: 0 # » # l«Hin6*T«Sf S 
|,(!)ttt,r^8, * L T ?8 SS « * 2 W T ii * « 

s-s a * 2 Ktt**ftfc»^apio*m^TB3:eD# 

3 * l» $ & ft 3 T?Jti6^ft/:^a55fiJS«ll3'?> , S25lfl 

* T * * r * fcOi^Tl'i, 

o * 0 * IS 8 # I «TttfKB«IK*nfcB*«i 

n 5 J: *5 t: tt T « . 

i;ni:»LT»2Hl:*t*i< HI # £ ft £ # # 
SflWSOCtC^oTli, « JS 38 * I . 2 6 * n e n 

2.1 i;»LTffpm^lin*o * L T ^ & # * 1 
ICffl*.&ftfc*jj«aM CTffilS$Eiafta8 "C 8 

T®aK*SttiS*i*« wOttH&afi** — KicJ:-* 
■T*fl>*15Sa*©-art*attL«fc -5 <h * * ffl 8 e» 

ttigtaottttww-^itton*, cot*. & s k 

/ y -tr - « « ^ « 82 * -f xrnis^a-Lx 

x >t< tu # * ft * o 

stasia > > * 'J 20*«jh LrWia 

vc vvttof i>J8a©a«>t/> > ms <a * # 

* T I* & . K- ^ ^ « S2 2 1 ii C (0 -t r y > h til « I- 
^ i> , ffl a » « 22* *W L T W ifi L A * « i" * 

iaftaLT^s, c<of?js&i8&*sti* dp-7 



HfflOfl 154-88875 (3) 

¥ *J £ w I , fl£ 35 J!S * 2 K fiS * '& ft rt: a W W 10K 
TfflEBftaftSM T38*R*ftT*i6£ftfcS*S 

««****!(»****«* 'T* 

£ 0 *B 33 «S * 1 WCttfUSAaaftfcaftlffi 
co&:5*<*^*£W*fldJ;*J£ft*<!:#ic* £ Q Sfl 

s * n fi a ? i: o t *j •) , fti^<oflsssfia^2 
Tf*^i»A**nfctti«Bir«a*is^*o« * ■& 
pBm**n*4Jtiw* b % a k a 4 t * a * n * 
*©aR»©3S»**<*^fll***ft**5 £ * 

ff^a««ttW*«ffitt5KWs « if « 3 ea *= 5% 

» 3 RJ I; * H T s 1 1 (* » «U J2li + -A^BH. 

*-A*«S12^&Brffi©*-A»A<tt*n5 * 
*oA*tfl«(*tt«SUli^&»tt*BaSRU*^t 



it 




V t r 


95 C *r 




*/»*ymcasHHftSft*. 








&83f?B723(*Sfl??&$24£&jftLT 


± «E L 


fc £a < 




aaft*:§j9t;i*s*a;w&Js-r* 


© T 








ft B U 


ft $ . 






t£ r 


, c co 






£ * ft 


* H 


IT 




* £ A< 


, - A* 






ft as* 


§ iC & 




* ft * <, :(DJ:^i:lT8ilSl4!i2 


£ ft 


S 2S 




*<lBia«Htta«l4*^ L T ifi <a 


0 tttt 






*„ c©i#±«aW4affll;:«* 


ti'tz * 


& t» n 


< 








a 


®&iz&to$nz 9 







-* 


s a <t isi a 


^ a 




S M 14* ft I 


r s a 


# n s t ta « t: 


L T 




sa 1 1 ii a a 3y 


© « 15 


ffi «l i 


N & » © n 


» t» « 


i * 




* y it 


(= 9>J >!r 


a m r s 


o amj 




65 2 5 li *B M ^ 


as st « 


26* © 


pa l t s m 


a ^ m 


ft » 


co m a \n a c 




# Sfl • 


sa » '< * / 




n * 







-521- 



^i£ 0 27u : to ji 7 tts ai ' 4* '< ^ - * « ?ii 

C tit o t S- P (3 f ^ US fli| ft fiS <c J: 0 ^ « L , D / 

Xttfld£fift*ftfc**<3^KJ: -o XX fcT - a 29*< 

Si! *R JT5 co ^ 25 trt 8l« * iX??lltf«lt L 

T JR 36 * X7U<13lCSfc*s£ft4,£'3(Ctt-,X 

H 4 0 

Kttttsnytitem^n^9Aic%i»* m sa m ap ais 
<t * 4 a< , n9«Et^j:?fctRrKin«>asffltt«t 

Cfl>J:oCittffi«|3|5*DHR-*"*c:4teJ;-.-C, 

* k a ft * ft 4 „ *LxtH^w©*jsa»*KTa 

ft, co + jltBU'/^f ft s L J* £ 

rrvis, * r > > h & & © is. ** $ /« * - > y * 

OR St * 2 4 , 8 EW & fiS 8£ 25, £flij&fiU*3 26, £ /* 
£ & 2 T , t Ltr-^ t iJlTi^or? Ay 

* y 30*e^.xtu*ni t> <o x 4 0 



£ CO 


n i; L t 


wsKfflr&tom&t* 




& # ^ is J: 


* ^ 


^ U T f 


ft^fttfttXtfJ/j 






J; ft 




s ft 5 i j§ \n n * 






^ ^ # 




& ts «i * a t , * 




» ss Bfr & co 


* » w 












x a* if IB # 


^ISfflt if Si: 






^ a * 


ffl * x * ft 


If . H W HI ?J $ ft 


fc 


& & ts n a 


it a> $> 


i* & JR 4 C 


t to ® 8 tt « S J 




A T > * * 






i A< «T H6 i « * . 




© tt m > * 






: t * w o -5 , 


** 


8*0 ¥ CO - 


a 7 > 


* ( St a > 


* s W uus s 


m 


^ ffi |5j t © 


*) » * 


id * 4 w t 


gfe £ * , 










m 





UlSJog (,4-88875.(4) 



n in fft o w ffi 


ts « ff 








Cf * 2? fij 


t 


U X 








T 








ft 


-5 e 




At 7? « as m 






T 


f 




ft 


is tJ? 




Q * a tB 8 I* 


H K * ft 


> 




© 




to 






* ft * ft 2S 


ft ® tt <c 








ft 6 o * 


L 


X * 


to 


ft Jfl m to S 25 


(ft tt * 






J: 


X * M 




L X 




co y 5 s < r * 


« & * 










ft 


^ o 


C £0 


fli , # * * 


SS M W i 






M 








ffl u . 


Z ft <s> CO A * 


< r to m 






W 


m i x u 


« 




<o ^ 


ts m n * * ft 


eft » * 


ttJ 




L 


x > a * 


5& 






© ffl © # # » 


30 « >5< 


ft 


to 


ft 












5K t>< A / 


D 






iBt IBi D 


/ 


A ffi 


m ^ 


2 8 £ & fit 4 


If J" 3 - 








« * #1 




X » 


^ $ 


ft v C O J* 


3 - f 7 






S3 


ti « $5 Stt 


14* it 


L X 


,s ft @ ta ;c & 


turn 






ft 


& *8 £ t; 


it 


, m 




$ 5 B| fc * 


J; -5 *c , 








/3 fat Ml 1- 
tfl IHI W X 


it 




Sfi if? 


X * A * St 


t* * . * 




T 


i_ 


to * * ffi 


ft 






te X ± a$ U fc 






ft 


ti 


*> t 5 i 




ic U 




(0 * * » |R 


X ir A ^ 




& 


L 


T tiU E 18 


Vk 3S 5fc 




vim&n « m m *a * * 


ft 




ft 


^ PL h X 


0 


iw -r 


ft tf 



X ii 






0 










=F » © 2 * 




X 


a ? 


u 


> 9 




CO 






K 




e 




S 5S X * 


r ft 




* s 




n >t* 




fc 


S JS 






to 


a a k « r 


5 53 R * 


ft 






© X 




-» 


X 




a 




o 


















(i 


A 




t 




CO 


a m & a ^ 


» K to a 


CO 
















CO 




St 




•3 ^ r ii 


S£ * 


m 


* ts 




* ft 


X 












*> 




x a ft a 








ft 








<0 


X 






9 






ft W tt * 


CO 






& fttt 


t 


U 




ft 


m 


X 








5fe id * 4 




i />< 


X 






























[ 


ft 




co 


id 


m 


] 




















± 




w 


u 


fz 


J: 




C * 5ft W 


i: ft 






m 








ffl 






% 


IS 




* *d i 


L X ^ co 


y 




T 


* * 








X 






tit 




4 co X 


, ftflKSV 




to * 














[Z 




it 


■r 






4 




cO 


SB 






(0 




m 


ts 


tfl 


co 


M it \z X 


x «« 




^ T 


> 


X <0 










t 


* 


J: 


9 


ta W ^ x 






¥ <M 


to 




















i j&< <n 


t <£ 4 <0 


X 










X 


CO 




ss 






ft? 


* * t: * 


C <h L 
























t 


nc 4 ^ff <o 






«£ 4 





-522- 







n * 






4 . 


Bn © 


n w 


tt ft 






3 1 S 


* <t 


if m 




m k 


ff * S 




ft 8 




SS 3 


0 (i * 




ft a 






IT fit , 




w u 






T A 5 










1.2- 


mis 


& * 


, 3 - a * s§ ff /« » 2St a , * 


... H 


% as ft 




5- 




ft as 


<. 7- 


B * 


HU □ 


6 # $ , e a 




9.10- 




2* . 


13- 9 * X 7 !✓ < > 14- 8)9 ** 




(fi s 15 


... «7 


<f 9 


a 7 * > , 16- A/D2C»»s 


18- 


* j» a « a 


. 19 


-tr ^ y > 21- * 


* & & as. 


2S- 


SB ft 


IS . 2 5- m M & fiS 8B , 27- 






28- 


D / A £ # . fcf-». 




Hi *i A « 


9 A 


# m ± » fr a s 



IHiaa 154 -88875 (5) 




0 3 H 



\f-<- 

29 13 
foisp] — 


- 0> 


^ A 


LA 27 


! 

2 


ii 




« 

in 


r 

?! 

1 


,? 

1 




-mm 


-V CO NT 




16 

- A j 


'° . t « 

S ' 


? £ 

tt 






f 
ft 


< 2 

t& 
* 


2 < 
fal 


_ iX 

f 



B * 














® 1 H 




$20 



-523- 



JP-S 64-8887 5 

A patent application public release S64-88875 
Public April 3, 1989 

Title of the invention 

Speech translation device 

Inventor: Hiroshi Matsuura, Teiichi Watanabe 
Applicant TOSHIBA 

Example 

It is explained about one embodiment of the invention when taken 
with the drawing as follows. 

Figure 1 ,2 are basic configuration example of speech translation 
device hanging in example of the present invention. 

By way of example only, it is realized as device to be able to leave 
by speech translation communication at a telephone handset interval. 

The language which user of telephone handset 1 employs here is 
Japanese. 

The language which a user of telephone handset 2 employs is 
English. 

Speech translation device does speech translation at Japanese / 
English interval. 

Speech translation device is configured as follows to do these. 

Japanese speech recognizer 3, speech recognition does a voice 
input Japanese voice to be able to go away from telephone handset 
1. 

Japanese-to-English compilation department 4 translates this 
recognized Japanese linguistic information into English linguistic 
information. 

In addition, English speech recognizer 5, speech recognition does a 
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voice input English voice to be able to go away from telephone 
handset 2. 

English-to-Japanese compilation department 6 translates this 
recognized English linguistic information into Japanese linguistic 
information. 

In speech translation device shown in figure 1 , synthesis converts 
translated linguistic information to English voice with English voice 
synthesis department 7 as depicted above. 

And voice output is done to telephone handset 2. 

In addition, synthesis is converted to a Japanese voice with 
Japanese voice synthesis department 8. 

And voice output is done to telephone handset 1 . 

Display part 9 comprised to telephone handset 1 is used in 
telephone handset 1 side as well as this. 

"The English statement that is linguistic information before 
Japanese translation pursued in above mentioned English speech 
recognizer 5" is displayed in total with previously described 
Japanese voice output. And, in telephone handset 2 side, display 
part 10 comprised to telephone handset 2 is used. 

The Japanese statement that is linguistic information before 
English translation pursued in said article Japanese speech 
recognizer 3 is displayed in total with previously described English 
voice output. In other words, in telephone handset 1 side, the 
Japanese which was able to leave speech recognition can leave voice 
output. In addition, it is displayed a character string an English 
statement before the translation. In other telephone handset 2 side, 
the English that was able to leave speech translation can leave voice 
output. In addition, it is displayed a character string a Japanese 
statement before the translation. As against this, speech translation 
device shown in figure 2 is explained in the following. 

The speech sound voice that it is input from telephone handset 1,2 
respectively can just leave voice output as against telephone handset 
2,1 of a counterpart. 
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And, in display part 9 comprised to telephone handset 1, it is 
displayed a character string the Japanese statement that is the 
linguistic information which it is translated with above-mentioned 
English and Japanese translation part 6, and was demanded. 

In representation 1 0 comprised to telephone handset 2, a character 
string displays the English statement that is the linguistic 
information which it is translated with above-mentioned Japan and 
Britain translation part 4, and was demanded. 

In other words English before the translation which was able to 
leave voice input can just leave voice input in telephone handset 1 
side. Along with it, it is displayed a character string a Japanese 
statement after translation pursued with English-to-Japanese 
compilation department 6. 

In other telephone handset 2 side, Japanese before the translation 
which was able to leave voice input can just leave voice output. 

Along with it, it is displayed a character string English statement 
after the translation pursued with Japanese-to-English compilation 
department 4. 

The speech translation facility that such a system configuration is 
adopted, and is realized is gained, and, for example, telephone 
handset is configured as shown in figure 3. 

In figure 3, there are 1 1 control section, 12 key input unit and 13 
displays. Speech translation communication is preceded, a 
prescribed key input is done from key input unit 12. 

The output information goes through network termination 14 from 
control section 11, and it is emitted by line. 

By means of this initial communicate mode, it seems to become the 
following. "Configuration of telephone handset and status (direct 
sound vocal communication or translation communication) of the 
information which is going to communicate", configuration (a 
specification of translation language) of translation are notified of. 

In addition, connection control of communication line is done. 

Message information necessary then goes through above 
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mentioned D play 13, and it is provided an output to indicate. 

By the way, the voice that mic 1 5 is gone through, and it was input 
goes through A/D converter 16, and it is taken. It is stored to data 
memory 17. In addition, an acoustic analysis such as filtering is 
given with speech analysis department 18. 

Segment converter 19 refers to standard pattern 1 memory 20. 

And "music, a syllable or segment information for speech 
recognition of a VCV unit" is demanded from above mentioned 
acoustic analysis result. Speech recognizer 2 1 acts on on in this 
segment information. 

It recognizes, and a previously described input sound voice is 
handled referring to recognition dictionary 22. 

This speech recognition process is done by means of dynamic 
programming matching method or a succession network. 

In doing so, as necessary phonic reentry is promoted. 

In this way, for example, demanded recognition result (linguistic 
information) is distinguished every clause unit. 

It is stored to above mentioned data memory 1 7 appropriately by 
these processes. Compilation department 23 refers to translation 
dictionary 24. Linguistic information recognized as above is 
translated. 

This translation is not only Japanese-to-English translation and 
English-to- Japanese compilation (translation at a predetermined 
language interval). 

In this translation communication system, translation at an interval 
with an intermediate language set by commonness is done. 

Configuration of the translation is generally set by every translation 
communications terminal. 

In this way translated linguistic information goes through 
above-mentioned network termination 14, and it is emitted by 
communication line. 

Linguistic information (information before translation) offered for 
the translation then goes through network termination 14, and it is 
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emitted by communication line. 

On the other hand, the linguistic information which network 
termination 14 is gone through, and is received is processed as 
follows by communication line. 

Control section 1 1 stores "linguistic information before translation" 
and "linguistic information after translation" to above mentioned 
data memory 17 separately. 

Speech synthesis by rule part 25 refers to speech synthesis by rule 
dictionary 26. 

It generates a phoneme / a prosody parameter list as opposed to 
linguistic information after translation. 

Voice synthesis department 27 acts on on in a subsidiary of such 
phoneme / prosody parameter, and audio signal is generated by 
speech synthesis by rule. 

And it is output through D/A converter 28. 

In this way speaker 29 is driven with the audio signal which was 
able to leave speech synthesis by rule. 

And it is expected that synthesized speech is emitted. 

In addition, linguistic information before translation is just 
displayed to above mentioned display 1 3 as subsidiary of character 
information. 

Such a serial process acts on a stored control program to program 
memory 30. 

It is carried out with control of above mentioned control section 1 1 . 

Voice synthesis does linguistic information after translation here, 
and it is output. 

And it is assumed that a character string displays linguistic 
information before translation. 

However, voice synthesis does linguistic information before 
translation as-previously-described, and it is output. 

And a character string can display linguistic information after 
translation. 

As thus described the voice that was able to leave Japanese input is 
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translated into English information by arranging telephone handset. 

And, the translation anteroposterior linguistic information, it is 
communicated by the other translation communications terminal. 

And translation anteroposterior linguistic information makes the 
media be different as a voice and a character string in telephone 
handset of a counterpart. 

And it is put together, and it is output. 

In addition, the information that was able to leave voice input in 
English is translated from the other telephone handset into Japanese 
information. 

The translation anteroposterior linguistic information is emitted by 
communication line respectively. 

And the translation anteroposterior linguistic information makes 
the media be different as a voice and a character string, and it is 
output in total. 

As a result, character string linguistic information is used together 
with spoken language information. 
A difference of these medias is used. 

And translation anteroposterior language glossary is put together 
respectively, and it is output. 

At Japanese and an English interval, speech translation 
communication is done. 

Telephone handset comprises only A/D converter 1 6 and voice Coe 
Dick comprising 28 D/A converter,, and it is configured. 

Network termination 14 is gone through, and this voice Coe Dick is 
connected to communication line. 

For this case, for example, being similar provide central translation 
system on the communication line as shown in figure 5. 

And it makes do above mentioned translation in this central 
translation system. 

And this central translation system is relayed, linguistic 
information of translation front and back should be given above 
mentioned telephone handset respectively. 
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This central translation system is configured by the following. 

Previously described speech analysis department 1 8 

Segment converter 1 9 , Standard pattern memory 20 , Department 
of voice vocabulary 2 1 , Lexical dictionary 22 , Compilation 
department 23, Translation dictionary 24 , Speech synthesis by rule 
part 25 , Speech synthesis by rule dictionary 26 , Voice synthesis 
department 27, Data memory 17, Program memory 30. 
These are possessed, and it is configured. 

In this way, according to this device which, at the same time, 
output translation anteroposterior linguistic information as a voice 
and a character string respectively, the following can say. 

While hearing the linguistic information which can leave voice 
output, it is language Get Info displayed a character string. 

And the translation anteroposterior linguistic information gets 
possible to be compared. 

Thus, if some factual knowledge as opposed to the language which 
an interaction partner employs is comprised, a nuance of difficult 
language of what translation grasps only from output linguistic 
information gets possible to be grasped easily. 

As a result, useless misunderstanding is prevented from occurring. 

And while understanding a nuance of an interaction partner, 
interaction at a heterologous language interval gets possible to be 
pushed forward. 

The present invention is not a thing limited to above mentioned 
example. 

By way of example only, it may be hardcopy device such as a 
printer for displaying means of a character string. 

In addition, compilation as opposed to language aside from the 
language which illustrated may be done. 

About "an input sound vocal recognition process, a method of 
translation, a method of a voice synthesis", it is processed as 
follows. 

A system specification is accepted, and a method proposed in these 
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system in various ways conventionally should be adopted. 
In addition, the present invention transforms it in the range that 
does not deviate from the subject matter, and it can be embodied. 

Brief description of drawings 

Figure 1 , 2 

Basic configuration example of speech translation device hanging 
in example of the present invention 

Figure 3 

Configuration example of telephone handset comprising a speech 
translation facility 

Figure 4 

Other examples to realize this device. 

(1) (2) telephone handset 

(3) a Japanese speech recognizer 

(4) Japanese-to-English compilation department 

(5) an English speech recognizer 

(6) English-to- Japanese compilation department 

(7) Japanese voice synthesis department 

(8) English voice synthesis department 

(9) (10) display part 

(13) display 

(14) network termination 

(15) microphone 

(16) A/D converter 

(18) speech analysis department 

(19) segment converter 
(21) speech recognizer 
(23) compilation department 
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(25) speech synthesis by rule part 

(27) voice synthesis department 

(28) D/A conversion department 

(29) speaker 



